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BACKGROUND OF THE INVENTION 

Field of the Invention 

5 This invention relates to the field of data processing systems. More 

particularly, this invention relates to mechanisms for interpreting program instructions 
into data processing operations within data processing systems. 

Description of the Prior Art 

10 It is known to provide data processing systems using interpreted program 

instructions. An example of program instructions that may require interpretation are 
Java bytecodes. These Java bytecodes typically require interpretation into one or 
more native instructions of a target processor core. The interpretation may generate 
the native instructions or control signals equivalent to the native instructions. 

15 

A problem that arises is that different Java Virtual Machines may choose 
differing mappings between at least some of the bytecodes that form program 
instructions and the data processing operations being represented. This is allowed for 
in the Java architecture in that a block of configurable bytecodes is provided, such as 
20 for use to represent resolved quick forms of desired instructions. There is an inherent 
difficulty between a desire to provide hardware mechanisms for interpreting such 
bytecodes and the variability of the bytecode mappings that may need representing for 
different Java Virtual Machines. In particular, it is strongly undesirable to need to 
provide different hardware for each different Java Virtual Machine. 

25 

One way of dealing with the above problem might be to use a software 
interpreter for any Java bytecode that does not have a fixed mapping. Whilst this does 
provide a working solution, it introduces a significant performance degradation since 
software interpretation of the programmable quick form program instructions 
30 introduces a significant slowing of what are performance critical instructions. 

SUMMARY OF THE INVENTION 

Viewed from one aspect the present invention provides apparatus for 
processing data under control of a set of program instructions that map upon 
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interpretation to data processing operations to be performed, said apparatus 
comprising: 

(i) a fixed mapping hardware interpreter operable to interpret a fixed 
mapping group of said set of program instructions, whereby a program instruction 

5 from said fixed mapping group maps to a fixed sequence of one or more data 
processing operations; and 

(ii) a programmable mapping hardware interpreter operable to interpret a 
programmable mapping group of said program instructions, whereby a program 
instruction from said programmable mapping group maps to a sequence of one or 

10 more data processing operation that varies in dependence upon programming of said 
programmable mapping hardware interpreter. 

The invention provides a synergistic combination of a fixed mapping hardware 
interpreter and a programmable mapping hardware interpreter. The programmable 
1 5 mapping hardware interpreter may be used for performance critical program 
instructions (bytecodes) that may vary their mapping depending upon the 
implementation concerned. 

In strongly preferred embodiments the bulk of variable or non-supported 
20 mappings may be dealt with by a software execution unit (such as a software 

interpreter or just in time compiler) when these are non performance critical. This 
reduces the hardware requirements of the system. Thus, the programmable mapping 
hardware interpreter can be focused upon the performance critical mappings to 
produce a significant performance gain with relatively little additional hardware 
25 overhead. 

The implementation of the technique is significantly simplified when the 
programmable mapping hardware interpreter has a fixed set of data processing 
operations (or more generally sequences of one or more data processing operations) to 
30 which program instructions may be mapped. This has the result that the hardware 
need only serve to generate the fixed and known interpreted instruction sequence 
whilst flexibility is maintained at the abstract level at which a program instruction 
(bytecode) is mapped to one of those fixed processing operations. 
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Preferred embodiments of the invention utilise a programmable translation 
table for translating between program instructions and data processing operations to 
be performed, as represented by operation values. 

5 The programmable translation table may conveniently be provided in the form 

of a content addressable memory or a random access memory. 

In order to prevent a user seeking to program the programmable translation 
table with mappings that are not supportable with the programmable mapping 
10 hardware interpreter, there is advantageously provided an invalid entry trap. Since the 
number of processing operations that may be mapped to is relatively small, the 
provision of such a trapping mechanism is advantageously straightforward. 

The technique may be used in a variety of situations, but is particularly well 
1 5 suited to situations in which program instructions are being mapped to data processing 
operations equivalent to one or more native program instructions on a target 
processing core. This type of hardware accelerated interpretation is strongly desirable 
and well suited to the particular task of Java bytecode interpretation. 

20 The provision of a software interpreter in combination with the fixed mapping 

hardware interpreter and the programmable mapping hardware interpreter allows a 
guaranteed level of coverage for all program instructions since any that cannot be 
handled by the hardware interpreters can be passed to the software interpreter, which 
whilst it may be slow, can use complex and detailed software techniques to provide 

25 the desired interpretation. 

It will be appreciated that the fixed mapping hardware interpreter and the 
programmable mapping hardware interpreter could be provided as separate entities, 
but are preferably provided in the form of circuitry whereby at least a portion of their 
30 hardware is shared. More particularly, the programmable mapping from a program 
instruction into a fixed representation for the hardware concerned is the principal 
distinguishing feature of the programmable mapping hardware interpreter and this can 
be provided by special purpose hardware, such as the above described programmable 
translation tables, with the hardware required to take a fixed representation of a 
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program instruction and generate an interpreted form to drive processing operations 
being shared between the two different types of hardware interpreter. 

The additional processing overhead of providing the programmable mapping 
5 within the programmable mapping hardware translator may be reduced in impact by 
the provision of a translation pipeline stage within which program instructions that are 
buffered may be subject to the desired programmable mapping prior to them being 
required for further processing in subsequent pipeline stages. 

10 Viewed from another aspect the present invention also provides a method of 

processing data under control of a set of program instructions that map upon 
j*4 interpretation to data processing operations to be performed, said method comprising 

g the steps of: 

(i) using a fixed mapping hardware interpreter to interpret a fixed 
ry 1 5 mapping group of said set of program instructions, whereby a program instruction 

from said fixed mapping group maps to a fixed sequence of one or more data 
« processing operations; and 

fj| (») using a programmable mapping hardware interpreter to interpret a 

j « programmable mapping group of said program instructions, whereby a program 

Q 20 instruction from said programmable mapping group maps to a sequence of one or 

more data processing operations that varies in dependence upon programming of said 

programmable mapping hardware interpreter. 

A complementary aspect of the present invention takes the form of a computer 
25 program product for controlling a data processing apparatus to provide interpretation 
of a set of program instructions that map upon interpretation to sequences of one or 
more data processing operations to be performed, said computer program product 
comprising: 

mapping configuration logic operable to program a programmable mapping 
30 hardware interpreter to interpret a programmable mapping group of program 

instructions, whereby a program instruction from said programmable mapping group 
maps to a sequence of one or more data processing operation that varies in 
dependence upon programming of said programmable mapping hardware interpreter. 
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As well as the invention being embodied within a physical system that carries 
out the desired mapping and a method of performing the desired mapping, the 
invention also expresses itself in the form of support computer program code that will 
typically be used to configure the programmable mapping hardware interpreter prior 
5 to its use. 

The above, and other objects, features and advantages of this invention will be 
apparent from the following detailed description of illustrative embodiments which is to 
1 0 be read in connection with the accompanying drawings. 

=k BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 illustrates a data processing system incorporating bytecode 
m translation hardware; 

= :: 15 

Figure 2 schematically illustrates software instruction interpretation of 
bytecodes; 

1i Figure 3 is a flow diagram schematically representing the operation of a code 

7 20 fragment within the software instruction interpreter that ends with a sequence 
U terminating instruction; 

Figure 4 is an example of a code fragment executed in place of a bytecode; 

25 Figure 5 illustrates an example data processing system that does not have 

hardware bytecode execution support; 

Figure 6 is a flow diagram illustrating the software instruction interpreter 
action when operating with the system of Figure 5; 

30 

Figure 7 illustrates the mapping between Java bytecodes and processing 
operations; 
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Figure 8 illustrates a programmable translation table in the form of a content 
addressable memory; 

Figure 9 illustrates a programmable translation table in the form of a random 
5 access memory; 

Figure 1 0 is a flow diagram schematically illustrating the initialising and 
programming of a programmable translation table; 

10 Figure 1 1 is a diagram schematically illustrating a portion of the processing 

pipeline within a system that performs Java bytecode interpretation; 

Figure 12 schematically illustrates a variable length instruction spanning two 
instruction words and two virtual memory pages; 

15 

Figure 13 schematically illustrates a portion of a data processing system 
pipeline including a mechanism for dealing with prefetch aborts of the type illustrated 
in Figure 12; 

20 Figure 14 gives a logical expression that is one way of specifying how a 

prefetch abort of the type illustrated in Figure 12 may be detected; 

Figure 15 schematically illustrates an arrangement of support code for abort 
handling and instruction emulation; 

25 

Figure 16 is a flow diagram schematically illustrating the processing 
performed to deal with prefetch aborts of variable length byte code instructions; 

Figure 17 illustrates the relationship between an operating system and various 
30 processes controlled by that operating system; 

Figure 1 8 illustrates a processing system including a processor core and a Java 
accelerator; 
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Figure 19 is a flow diagram schematically illustrating the operations of an 
operating system in controlling the configuration of a Java accelerator; 

Figure 20 is a flow diagram schematically illustrating the operation of a Java 
5 Virtual Machine in conjunction with a Java acceleration mechanism that it is using in 
controlling the configuration of the Java acceleration mechanism; 

Figure 21 illustrates a data processing system incorporating bytecode translation 
hardware as in Figure 1, further incorporating a floating point subsystem; 

10 

Figure 22 illustrates a data processing system incorporating bytecode translation 
hardware as in Figure 1 and a floating point subsystem as in Figure 21, further 
incorporating a floating point operation register and an unhandled operation state flag; 

15 Figure 23 shows the ARM floating point instructions generated for Java floating 

point instructions; 

Figure 24 shows a sequence of ARM instructions that might be generated by the 
Java acceleration hardware for the Java 'dmul' and 'dcmpg' instructions; 

20 

Figure 25 shows the sequence of operations when executing a 'dmul' 
instruction followed by a 'dcmpg' instruction where an unhandled floating point 
operation is caused by execution of the FCMPD instruction generated by the Java 
acceleration hardware for the Java 'dmul' instruction, the sequence of operations 
25 shown is for a system using imprecise unhandled operation detection corresponding to 
Figure 22; 

Figure 26 shows the state of the Floating Point Operation Register and the 
Unhandled Operation State Flag after execution of the FMULD instruction in Figure 
30 25; 

Figure 27 shows the sequence of operations when executing a 'dmul' 
instruction followed by a 'dcmpg' instruction where an unhandled floating point 
operation is caused by execution of the FCMPD instruction generated by the Java 
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acceleration hardware for the Java 'dcmpg' instruction, the sequence of operations 
shown is for a system using imprecise unhandled operation detection corresponding to 
Figure 22; 

5 Figure 28 shows the state of the Floating Point Operation Register and the 

Unhandled Operation State Flag after execution of the FCMPD instruction in Figure 
27; 

Figure 29 shows the sequnce of operations when executing a 'dmul' instruction 
followed by a 'dcmpg' instruction where an unhandled floating point operation is 
10 caused by execution of the FMULD instruction generated by the Java acceleration 
hardware for the Java 'dmul' instruction, the sequence of operations shown is for a 
system using precise unhandled operation detection corresponding to Figure 21 ; and 

Figure 30 shows the sequence of operations when executing a 'dmul' 
15 instruction followed by a 'dcmpg' instruction where an unhandled floating point 
operation is caused by execution of the FCMPD instruction generated by the Java 
acceleration hardware for the Java 'dcmpg' instruction, the sequence of operations 
shown is for a system using precise unhandled operation detection corresponding to 
Figure 21. 

20 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Figure 1 illustrates a data processing system 2 that incorporates a processor 
core 4, such as an ARM processor, and bytecode translation hardware 6 (also called 
Jazelle). The processor core 4 includes a register bank 8, an instruction decoder 10 

25 and a datapath 12 for performing various data processing operations upon data values 
stored within the registers of the register bank 8. A register 18 is provided which 
includes a flag 20 which controls whether the bytecode translation hardware 6 is 
currently enabled or disabled. In addition, a register 19 is provided which includes a 
flag 21 which indicates whether the bytecode translation hardware is currently active 

30 or inactive. In other words flag 21 indicates whether the data processing system is 
currently execute Java bytecodes or ARM instructions. It will be appreciated that in 
other embodiments the registers 18 and 19 could be a single register containing both 
the flags 20 and 21. 
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In operation, if Java bytecodes are being executed and the bytecode translation 
hardware 6 is active, then Java bytecodes are received by the bytecode translation 
hardware 6 and serve to generate a sequence of corresponding ARM instructions (in 
this particular non-limiting example embodiment), or at least processor core 

5 controlling signals representing ARM instructions, that are then passed to the 

processor core 4. Thus, the bytecode translation hardware 6 may map a simple Java 
bytecode to a sequence of corresponding ARM instructions that may be executed by 
the processor core 4. When the bytecode translation hardware is inactive, it will be 
bypassed and normal ARM instructions can be supplied to the ARM instruction 

10 decoder 10 to control the processor core 4 in accordance with its native instruction 
set. It will be appreciated throughout that the sequences of ARM instructions could 
equally be sequences of Thumb instructions and/or mixtures of instruction from 
different instruction sets and such alternatives are envisaged and encompassed. 



15 It will be appreciated that the bytecode translation hardware 6 may only 

provide hardware translation support for a subset of the possible Java bytecodes that 
may be encountered. Certain Java bytecodes may require such extensive and abstract 
processing that it would not be efficient to try and map these in hardware to 
corresponding ARM instruction operations. Accordingly, when the bytecode 

20 translation hardware 6 encounters such a non-hardware supported bytecode, it will 
trigger a software instruction interpreter written in ARM native instructions to 
perform the processing specified by that non-hardware supported Java bytecode. 



The software instruction interpreter may be written to provide software 
25 support for all of the possible Java bytecodes that may be interpreted. If the bytecode 
translation hardware 6 is present and enabled, then only those Java bytecodes that are 
non-hardware supported will normally be referred out to the relevant code fragments 
within the software instruction interpreter. However, should bytecode translation 
hardware 6 not be provided, or be disabled (such as during debugging or the like), 
30 then all of the Java bytecodes will be referred to the software instruction interpreter. 



Figure 2 schematically illustrates the action of the software instruction 
interpreter. A stream of Java bytecodes 22 represents a Java program. These Java 
bytecodes may be interspersed with operands. Thus, following execution of a given 
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Java bytecode, the next Java bytecode to be executed may appear in the immediately 
following byte position, or may be several byte positions later if intervening operand 
bytes are present. 

5 As shown in Figure 2, a Java bytecode BC4 is encountered which is not 

supported by the bytecode translation hardware 6. This triggers an exception within 
the bytecode translation hardware 6 that causes a look up to be performed within a 
table of pointers 24 using the bytecode value BC4 as an index to read a pointer P#4 to 
a code fragment 26 that will perform the processing specified by the non-hardware 
10 supported bytecode BC4. A base address value of the table of pointers may also be 
stored in a register. The selected code fragment is then entered with R14 pointing to 
the unsupported bytecode BC4. 

As illustrated, as there are 256 possible bytecode values, the table of pointers 
15 24 contains 256 pointers. Similarly, up to 256 ARM native instruction code 

fragments are provided to perform the processing specified by all the possible Java 
bytecodes. (There can be less than 256 in cases where two bytecodes can use the 
same code fragment). The bytecode translation hardware 6 will typically provide 
hardware support for many of the simple Java bytecodes in order to increase 
20 processing speed, and in this case the corresponding code fragments within the 
software instruction interpreter will never be used except if forced, such as during 
debug or in other circumstances such as prefetch aborts as will be discussed later. 
However, since these will typically be the simpler and shorter code fragments, there is 
relatively little additional memory overhead incurred by providing them. 
25 Furthermore, this small additional memory overhead is more than compensated by the 
then generic nature of the software instruction interpreter and its ability to cope with 
all possible Java bytecodes in circumstances where the bytecode translation hardware 
is not present or is disabled. 

30 It will be seen that each of the code fragments 26 of Figure 2 is terminated by 

a sequence terminating instruction BXJ. The action of this sequence terminating 
instruction BXJ varies depending upon the state of the data processing system 2 as 
will be illustrated in Figure 3. Figure 3 is a flow diagram illustrating in a highly 
schematic form the processing performed by a code fragment 26 within the software 



11 



P11322US 



instruction interpreter. At step 28, the operation specified by the Java bytecode being 
interpreted is performed. At step 30, the next Java bytecode to be executed is read 
from the bytecode stream 22 and the bytecode pointer within the Java bytecode 
stream 22 corresponding to this next Java bytecode is stored within a register of the 
5 register bank 8, namely R14. Thus, for the Java bytecode BC4 of Figure 2, the next 
Java bytecode will be BC5 and register R14 will be loaded with a pointer to the 
memory location of the Java bytecode BC5. 

At step 32, the pointer within the table of pointers 24 corresponding to the 
10 next Java bytecode BC5 is read from the table of pointers 24 and stored within a 
register of the register bank 8, namely register R12. 

It will be appreciated that Figure 3 illustrates the steps 28, 30 and 32 being 
performed separately and sequentially. However, in accordance with known 
15 programming techniques the processing of steps 30 and 32 may be conveniently 
interleaved within the processing of step 28 to take advantage of otherwise wasted 
processing opportunities (cycles) within the processing of step 28. Thus, the 
processing of steps 30 and 32 can be provided with relatively little execution speed 
overhead. 

20 

Step 34 executes the sequence terminating instruction BXJ with register R14 
specified as an operand. 

Prior to executing the BXJ instruction at step 34, the state of the system has 
25 been set up with the pointer to the next Java bytecode within the Java bytecode stream 
22 being stored within register R14 and the pointer to the code fragment 
corresponding to that next Java bytecode being stored within the register R12. The 
choice of the particular registers could be varied and none, one or both specified as 
operands to the sequence terminating instruction or predetermined and defined by the 
30 architecture. 

Steps 28, 30, 32 and 34 are predominantly software steps. The steps 
subsequent to step 34 in Figure 3 are predominantly hardware steps and take place 
without separate identifiable program instructions. At step 36, the hardware detects 
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whether or not the bytecode translation hardware 6 is active. It does this by reading 
the register flag values for the presence and the enablement of the bytecode 
translation hardware 6. Other mechanisms for determining the presence of active 
bytecode translation hardware 6 are also possible. 

5 

If bytecode translation hardware 6 is present and enabled, then processing 
proceeds to step 3 8 at which control is passed to the bytecode translation hardware 6 
together with the contents of the register R14 specifying the bytecode pointer to a 
bytecode within the bytecode stream 22 which the bytecode translation hardware 6 
10 should attempt to execute as its next bytecode. The action of the code fragment 26 
illustrated then terminates. 

Alternatively, if the determination at step 36 is that there is no bytecode 
translation hardware 6 or the bytecode translation hardware is disabled, then 
15 processing proceeds to step 40 at which a jump within the native ARM instruction 
code is made to commence execution of the code fragment within the software 
instruction interpreter that is pointed to by the address stored within register R12. 
Thus, rapid execution of the next code fragment is initiated yielding an advantage in 
processing speed. 

20 

Figure 4 illustrates a particular code fragment in more detail. This particular 
example is an integer addition Java bytecode, whose mnemonic is iadd. 

The first ARM native instruction uses the bytecode pointer in register R14 
25 incremented by one to read the next bytecode value (an integer add instruction does 
not have any following bytecode operands and so the next bytecode will immediately 
follow the current bytecode). The bytecode pointer in register R14 is also updated 
with the incremented value. 

30 The second and third instructions serve to retrieve from the stack the two 

integer operand values to be added. 

The fourth instruction takes advantage of what would otherwise be a wasted 
processing cycle due to register interlocking on register R0 to retrieve the address 
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value of the code fragment for the next bytecode stored in register R4 and store this 
address within register R12. A register Rexc is used to store a base pointer to the start 
of the table of pointers 24. 

5 The fifth instruction performs the integer add specified by the Java bytecode. 

The sixth instruction stores the result of the Java bytecode back to the stack. 

The final instruction is the sequence terminating instruction BXJ specified 
10 with the operand R12. The register R12 stores the address of the ARM code fragment 
that will be needed to software interpret the next Java bytecode should software 
interpretation be required. The execution of the BXJ instruction determines whether 
or not there is present enabled bytecode translation hardware 6. If this is present, then 
control passes to this bytecode translation hardware 6 together with the operand stored 
15 in register R14 specifying the next bytecode address. If active bytecode translation 
hardware 6 is not present, then execution of the code fragment for the next bytecode 
as pointed to by the address value within register R12 is started. 

Figure 5 schematically illustrates a data processing system 42 similar to that of 
20 Figure 1 except that in this case no bytecode translation hardware 6 is provided. In 
this system flag 21 always indicates that ARM instructions are being executed and 
attempts to enter Java bytecode execution with a BXJ instruction are always treated as 
though the bytecode translation hardware 6 were disabled, with flag 20 being ignored. 

25 Figure 6 illustrates a flow diagram of the processing performed by the system 

42 in executing a Java bytecode. This is similar to the processing of Figure 3 in that 
the same software interpreter code is being used except that in this case when the 
sequence terminating instruction BXJ is executed, there is never the possibility of 
hardware bytecode support and accordingly processing always continues with a jump 

30 to execute the code fragment pointed to by R12 as being the code fragment for the 
next Java bytecode. 

It will be appreciated that the software instruction interpreter in this case is 
provided as ARM native instructions. The software instruction interpreter (and other 
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support code) may be provided as a separate computer program product in its own 
right. This computer program product may be distributed via a recording medium, 
such as a floppy disk or a CD or might be dynamically downloaded via a network 
link. In the context of embedded processing applications, to which the present 
5 invention is particularly well suited, the software instruction interpreter may provided 
as firmware within a read only memory or some other non- volatile program storage 
device within an embedded system. 

Figure 7 illustrates the relationship between Java bytecodes and the processing 
operations that they specify. As will be seen from Figure 7, the 8-bit Java bytecodes 
provide 256 possible different bytecode values. The first 203 of these Java bytecodes 
are subject to fixed bindings as specified within the Java standard, to corresponding 
processing operations, such as iadd discussed previously. The last two Java 
bytecodes, namely 254 and 255, are described in The Java Virtual Machine 
Specification as being implementation defined. Therefore a Java implementation is 
fee to assign fixed bindings to these bytecodes. Alternatively a Java implementation 
may choose to treat these as having programmable bindings. Jazelle specifies fixed 
bindings for these bytecodes. Between bytecode values 203 and 253 inclusive, 
programmable bindings may be specified as desired by a user. These are typically 
used to provide bindings between bytecodes and processing operations, such as quick 
form bytecodes that are resolved during run time (see The Java Virtual Machine 
Specification, authors Tim Lindholm and Frank Yellin, publishers Addison Wesley, 
ISBN 0-20 1-63452-X). 

25 It will be appreciated from Figure 7 that whilst hardware accelerated 

interpretation techniques are well suited to dealing with the fixed bindings, these 
techniques are less well suited to dealing with the programmable bindings. Whilst it 
would be possible to treat all of the programmable bindings using software 
interpretation techniques, such as interpreting of the relevant bytecodes to be 

30 represented by corresponding code fragments, this would be slow for what in some 
cases can be performance critical bytecodes. 

Figure 8 illustrates one form of programmable translation table. This 
programmable translation table 100 is in the form of a content addressable memory. 
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A bytecode to be translated is input to a CAM lookup array 102. If this array 102 
contains a matching bytecode entry, then a hit is generated that causes a 
corresponding operation specifying value to be output, i.e. 

if there is a matching bytecode entry in the CAM table, then the hardware uses 
5 the operation specifying code to determine an operation to be performed in hardware, 
performs that operation and moves on to the next bytecode; 

if there is not a matching bytecode entry in the CAM table, then the bytecode 
is treated as non-hardware supported and its code fragment is called. 

10 In this example, the operation specifying values are 4-bit values and the CAM 

entry that has given rise to the hit corresponds to bytecode bc6. As will be understood 
from Figure 7, all of the bytecodes that may be subject to such programmable 
translation have their most significant two bits as "1" and accordingly only the least 
significant 6 bits of the bytecode need be input to the array 102. 

15 

The programmable translation table 100 in this example has eight entries. The 
number of entries present may be varied depending upon the amount of hardware 
resources that it is desired to dedicate to this task. In some examples only four entries 
may be provided, whilst in other ten entries may be appropriate. It may also be 
20 possible to provide an entry for every possible programmable binding bytecode. 

It will be appreciated that if the programmable mapping resources available 
are first filled with the most critical translation, then less critical translations may be 
subject to software interpretation. The provision of the software interpreter in 
25 combination with the programmable translation table allows the configuration of the 
system and the programming of the table to be made without it being necessary to 
know how many table entries are available since if the table overflows, then the 
required translations will be trapped and performed by the software interpreter. 

30 Figure 9 illustrates a second example programmable translation table 1 04. In 

this example the translation table is provided in the form of a random access memory 
with the bytecode to be translated to be input to a decoder 1 06 which treats the 
bytecode as an address to an RAM array 108 of 4-bit words each representing an 
operation specifying code. In this case an operation specifying code will always be 
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found for the bytecode. As a result, this type of table uses one extra operation 
specifying code, which specifies "call the code fragment for this bytecode". 

Figure 10 is a schematic flow diagram illustrating the initialisation and 
5 configuration of a programmable mapping hardware interpreter having the form of the 
example of Figure 8. In practice, different portions of the actions illustrated in this 
flow diagram are respectively performed by software initialisation instructions and the 
hardware responding to those instructions. 

10 At step 1 10, a table initialisation instruction is executed that serves to clear all 

existing table entries and set a pointer to the top entry in the table. Subsequent to this, 
initialisation code may execute to load mappings into the translation table using 
program instructions such as coprocessor register loads. The different forms of these 
table loading instructions can vary depending upon the particular circumstances and 

15 environment. The programmable mapping hardware interpreter system responds to 
these instructions by receiving a program instruction value, such as a Java bytecode, 
and the operation value to be associated with this at step 112. At step 1 14, 
unsupported operation trap hardware checks that the operation value being 
programmed is one that is supported by that programmable mapping hardware 

20 interpreter. Different programmable mapping hardware interpreters may support 

different sets of operation values and so may be provided with their own specific trap 
hardware. The trap hardware can be relatively simple if a particular system for 
instance knows that it supports operation values 0,1,2,3,4,5,6,7,8,10, but not 9. A 
hardware comparator at step 114 can compare the operation value for equality with a 

25 value of 9 and reject the programming by diverting processing to step 1 1 6 if a 9 
detected. 

Assuming that step 1 14 indicates that the operation value is supported, then 
step 118 checks to determine whether or not the end of the programmable mapping 
30 table has already been reached. If the programmable mapping table is already full, 
then processing again proceeds to step 116 without a new mapping being added. The 
provision of step 118 within the hardware means that the support code may seek to 
program the programmable mapping table without a knowledge of how many entries 
are available with the hardware merely rejecting overflowing entries. Thus, the 
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programmer should place the most critical mappings at the start of the table 
programming to ensure that these take up slots that are available. The avoidance of 
the need for the support code to know how many programmable slots are available 
means that a single set of support code may operate upon multiple platforms. 

5 

Assuming the table has a vacant entry, then the new mapping is written into 
that entry at step 120 and the table pointer then advanced at step 122. 

At step 1 16, the system tests for more program instruction values to be 
10 programmed into the programmable mapping table. Step 1 16 is typically a software 
step with the support code seeking to program as many mappings as it wishes during 
initialisation of the system. 



In the case of initialising a RAM table as shown in Figure 9, the process 
15 described above in relation to Figure 10 may be followed subject to the following 
modifications: 

that in step 1 1 0, the table is cleared by setting all table entries in array 1 08 of 
Figure 9 to "call the bytecode fragment for this bytecode" rather than by setting the 
array 1 02 in Figure 8 so that each entry does not match any bytecode; 
20 that in step 1 10, there is no translation table pointer to be initialised; 

that step 1 1 8 does not exist, because there is no translation table pointer; 

that step 120 becomes "write operation value to table entry indicated by 
program instruction value"; and 

that step 122 does not exist, since there is no translation table pointer. 

25 

Figure 1 1 illustrates a portion of a processing pipeline that may be used for 
Java bytecode interpretation. The processing pipeline 124 includes a translation stage 
126 and a Java decode stage 128. A subsequent stage 130 could take a variety of 
different forms depending upon the particular implementation. 

30 

Words from the Java bytecode stream are loaded alternately into the two 
halves of the swing buffer 132. Normally, multiplexor 133 selects the current 
bytecode and its operands from swing buffer 132 and delivers it via multiplexor 137 
to latch 134. If swing buffer 132 is empty because the pipeline has been flushed or for 
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some other reason, then multiplexor 135 selects the correct bytecode directly from the 
incoming word of the Java bytecode stream and delivers it to latch 134. 

The first cycle of decode for a bytecode is done by the first cycle decoder 146, 
5 acting on the bytecode in latch 134. In order to allow for cases where a 

hardware-supported bytecode has operands, further multiplexors select the operands 
from swing buffer 132 and deliver them to the first cycle decoder 146. These 
multiplexors are not shown in the figure, and are similar to multiplexors 133. 
Typically, the first cycle decoder 146 has more relaxed timing requirements for the 
10 operand inputs than for the bytecode input, so that a bypass path similar to that 

provided by multiplexors 135 and 137 and latch 134 is not required for the operands. 

If the swing buffer 132 contains insufficient operand bytes for the bytecode in 
latch 134, then the first cycle decoder 146 stalls until sufficient operand bytes are 
15 available. 

The output of the first cycle decoder 146 is an ARM instruction (or set of 
processor core controlling signals representing an ARM instruction) which is passed 
to the subsequent pipeline stage 130 via the multiplexor 142. A second output is an 
20 operation specifying code which is written to latch 138 via multiplexor 139. The 
operation specifying code contains a bit 140 which specifies whether this is a 
single-cycle bytecode. 

On the next cycle, the following bytecode is decoded by the first cycle decoder 
25 146 as previously described. If bit 140 indicates a single-cycle bytecode, then that 
bytecode is decoded and controls the subsequent pipeline stage 130 as previously 
described. 

If bit 140 instead indicates a multicycle bytecode, then the first cycle decoder 
30 146 is stalled and the multicycle or translated decoder 144 decodes the operation 

specifying code in latch 138 to produce an ARM instruction (or set of processor core 
controlling signals representing an ARM instruction), which the multiplexor 142 
passes to the subsequent pipeline stage 130 instead of the corresponding output of the 
first cycle decoder 146. The multicycle or translated decoder also produces a further 
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operation specifying code which is written to latch 138 via multiplexor 139, again 
instead of the corresponding output of the first cycle decoder 146. This further 
operation specifying code also contains a bit 140 which specifies whether this is the 
last ARM instruction to be produced for the multicycle bytecode. The multicycle or 
5 translated decoder 144 continues to be generate further ARM instructions as described 
above until bit 140 indicates that the last ARM instruction has been produced, and 
then the first cycle decoder 146 ceases to be stalled and produces the first ARM 
instruction for the following bytecode. 



10 The process described above is modified in three ways when the bytecode in 

latch 134 needs to be translated. First, the bytecode is extracted from the swing buffer 
j^J 1 32 by the multiplexor 1 33 and translated by the bytecode translator 136, producing 

□ an operation specifying code which is written to latch 138 via multiplexor 139. This 

operation specifying code has bit 140 set to indicate that the last ARM instruction has 
ru 15 not been produced for the current bytecode. so that multiplexor 142 and multiplexor 
LH 139 will select the outputs of the multicycle or translated decoder 144 in place of 

thoseaof the first cycle decoder 146 on the first cycle of the translated bytecode. 

fu 

ry 

Secondly, the multicycle or translated decoder 144 generates all of the ARM 
i 20 instructions to be passed to the subsequent pipeline stage 1 30 and their corresponding 
further operation specifying codes to be written back into latch 138, rather than only 
generating those after the first cycle as it would for a bytecode that does not require 
translation. 



25 Thirdly, if the bytecode was written directly to latch 134 via multiplexor 135 

and so was not present in the swing buffer 132 and could not have been translated by 
the bytecode translator 136 on the previous cycle, then the first cycle decoder 146 
signals the bytecode translator 136 that it must restart and stalls for a cycle. This 
ensures that when the first cycle decoder 146 ceases to stall, latch 138 holds a valid 

30 operation specifying code for the translated bytecode. 

It will be seen from Figure 1 1 that the provision of a translation pipeline stage 
enables the processing required by the programmable translation step to effectively be 
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hidden or folded into the pipeline since the buffered instructions may be translated in 
advance and streamed into the rest of the pipeline as required. 

It will be seen in Figure 1 1 that in this example embodiment the fixed 
5 mapping hardware interpreter can be considered to be formed principally by the first 
cycle decoder 146 and the multicycle or translated decoder 144 operating in the mode 
in which it decodes multicycle bytecodes that have been subject to first cycle 
decoding by the first cycle decoder 146. The programmable mapping hardware 
interpreter in this example can be considered to be formed by the bytecode translator 
10 136 and the multicycle or translated decoder 144 in this instance operating subsequent 
to translation of a programmable bytecode. The fixed mapping hardware interpreter 
and the programmable mapping hardware interpreter may be provided in a wide 
variety of different ways and may share significant common hardware whilst retaining 
i«* their different functions from an abstract point of view. All these different 

^ 15 possibilities are encompassed within the present described techniques. 
Lfl 

q Figure 12 illustrates two 32-bit instruction words 200, 202 that span a virtual 

..:J memory page boundary 204. This may be a lkB page boundary, although other page 

Lft sizes are possible. 




The first instruction word 200 is within a virtual memory page that is properly 
mapped within the virtual memory system. The second instruction word 202 lies within 
a virtual memory page that is not at this stage mapped within the virtual memory system. 
Accordingly, a two-byte variable length instruction 206 that has its first byte within the 

25 instruction word 200 and its second byte within the instruction word 202 will have a 
prefetch abort associated with its second byte. Conventional prefetch abort handling 
mechanisms that, for example, only support instruction word aligned instructions may 
not be able to deal with this situation and could, for example, seek to examine and repair 
the fetching of the instruction word 200 containing the first byte of the variable length 

30 instruction 206 rather than focusing on the instruction word 202 containing the second 
byte of that variable length instruction word 206 that actually led to the abort. 

Figure 13 illustrates a part of an instruction pipeline 208 within a data processing 
system for processing Java bytecodes that includes a mechanism for dealing with 
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prefetch aborts of the type illustrated in Figure 12. An instruction buffer includes two 
instruction word registers 210 and 212 that each store a 32-bit instruction word. The 
Java bytecodes are each 8-bits in length, accompanied by zero or more operand values. 
A group of multiplexers 214 serve to select the appropriate bytes from within the 
5 instruction word registers 210 and 212 depending upon the current Java bytecode pointer 
position indicating the address of the first byte of the current Java bytecode instruction to 
be decoded. 

Associated with each of the instruction word registers 210 and 212 are respective 
10 instruction address registers 216, 218 and prefetch abort flag registers 220 and 222. 
These associated registers respectively store the address of the instruction word to which 
they relate and whether or not a prefetch abort occurred when that instruction word was 
fetched from the memory system. This information is passed along the pipeline together 
with the instruction word itself as this information is typically needed further down the 
15 pipeline. 

Multiplexers 224, 226 and 228 allow the input buffer arrangement to be 
bypassed if desired. This type of operation is discussed above. It will be appreciated 
that the instruction pipeline 208 does not, for the sake of clarity, show all of the features 
20 of the previously discussed instruction pipeline. Similarly, the previously discussed 
instruction pipeline does not show all of the features of the instruction pipeline 208. In 
practice a system may be provided with a combination of the features shown in the two 
illustrated instruction pipelines. 

25 Within a bytecode decoding stage of the instruction pipeline 208, a bytecode 

decoder 230 is responsive to at least a Java bytecode from multiplexer 224, and 
optionally one or two operand bytes from multiplexers 226 and 228, to generate a 
mapped instruction(s) or corresponding control signals for passing to further stages in 
the pipeline to carry out processing corresponding to the decoded Java bytecode. 

30 

If a prefetch abort of the type illustrated in Figure 12 has occurred, then whilst 
the Java bytecode itself may be valid, the operand values following it will not be valid 
and correct operation will not occur unless the prefetch abort is repaired. A bytecode 
exception generator 232 is responsive to the instruction word addresses from the 
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registers 216 and 21 8 as well as the prefetch abort flags from the registers 220 and 222 to 
detect the occurrence of the type of situation illustrated in Figure 12. If the bytecode 
exception generator 232 detects such a situation, then it forces a multiplexer 234 to issue 
an instruction or control signals to the subsequent stages as generated by the bytecode 
5 exception generator itself rather than as generated by the bytecode decoder 230. The 
bytecode exception generator 232 responds to the detection of the prefetch abort 
situation of Figure 12 by triggering the execution of an ARM 32-bit code fragment 
emulating the Java bytecode being aborted rather than allowing the hardware to interpret 
that Java bytecode. Thus, the variable length Java instruction 206 that was subject to the 
10 prefetch abort will not itself be executed, but will instead be replaced by a sequence of 
32-bit ARM instructions. The ARM instructions used to emulate the instruction are 

w% likely to be subject to data aborts when loading one or more of the operand bytes, 

with these data aborts occurring for the same reasons that prefetch aborts occurred 
when those bytes were originally fetched as part of the second instruction word 202, 

:= J 15 and it is also possible that further prefetch and data aborts will occur during execution 

i ! f of the ARM 32-bit code fragment. All of these aborts occur during ARM instruction 

execution and so will be handled correctly by existing abort exception handler 

;r! routines. 

i ?! 

; ;; 4 20 In this way the prefetch abort that occurred upon fetching the bytecodes is 



suppressed (i.e. not passed through to the ARM core). Instead an ARM instruction 
sequence is executed and any aborts that occur with these ARM instructions will be dealt 
with using the existing mechanisms thus stepping over the bytecode that had a problem. 
After execution of the emulating ARM instructions used to replace the bytecode with an 
abort, execution of bytecodes may be resumed. 



If the bytecode itself suffers a prefetch abort, then an ARM instruction marked 
with a prefetch abort is passed to the rest of the ARM pipeline. If and when it reaches 
the Execute stage of the pipeline, it will cause a prefetch abort exception to occur: this 
30 is a completely standard way of handling prefetch aborts on ARM instructions. 

If the bytecode does not suffer a prefetch abort, but one or more of its 
operands do, as shown in Figure 12, then the software code fragment for that bytecode 
is called. Any ARM instructions passed to the rest of the ARM pipeline to cause the 
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code fragment to be called will not be marked with a prefetch abort, and so will 
execute normally if and when they reach the Execute stage of the pipeline. 

Figure 14 illustrates a logical expression of the type that may be used by the 
5 bytecode exception generator 232 to detect the type of situation illustrated in Figure 12. 
Denote by "Halfl" whichever half of the swing buffer in Figure 13 (blocks 210, 216, 
220 form one half, while blocks 212, 218, 222 form the other half, as denoted by the 
dashed lines around these elements in Figure 13) currently holds the first instruction 
word (200 in Figure 12), and by "Half2" the other half of the swing buffer, which 
10 holds the second instruction word (202 in Figure 12). Let P A(Halfl )mean the contents 
of whichever of blocks 220 and 222 is in Halfl, and similarly for Half2. 

y Then the indicators of the situation described in Figure 12 are that PA(Halfl) 

CI 

i'B is false, PA(Half2) is true, and the bytecode plus its operands span the boundary 

n \ 1 5 between the two swing buffer halves. (The fact that there is a page boundary marked 

there is simply because that is normally a requirement for it to be possible for the two 

PAO values to differ.) 

□ 

ru 

I'll In preferred designs such as ones where the swing buffer halves each store a 

Iff 

20 word, and hardware-supported bytecodes are limited to a maximum of 2 operands, the 

' 11 formula for determining whether the bytecode plus its operands span the boundary is: 

((number of operands = 1) AND (bcaddr[l:0] = 1 1)) 
OR ((number of operands = 2) AND (bcaddr[l] = 1)) 

25 

where bcaddr is the address of the bytecode. This allows the logical expression 
shown in Figure 14 to be derived. 

Other techniques for identifying a prefetch abort may be used, such as a variable 
30 length instruction starting within a predetermined distance of a memory page boundary. 

Figure 15 schematically illustrates the structure of the support code associated 
with the Java bytecode interpretation. This is similar to the previously discussed figure, 
but in this case illustrates the inclusion of the pointers to bytecode exception handling 
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code fragments that are triggered by bytecode exception events. Thus, each of the Java 
bytecodes has an associated ARM code fragment that emulates its operation. 
Furthermore, each of the bytecode exceptions that may occur has an associated portion 
of ARM exception handling code. In the case illustrated, a bytecode prefetch abort 
5 handling routine 236 is provided to be triggered upon detection of the above discussed 
type of prefetch abort by the bytecode exception generator 232. This abort handling 
code 236 acts by identifying the bytecode at the start of the variable length instruction 
that gave rise to its triggering, and then invoking the corresponding emulation code 
fragment for that bytecode within the collection of code fragments. 

10 

Figure 16 is a flow diagram schematically illustrating the operation of the 
bytecode exception generator 232 and the subsequent processing. Step 238 serves to 
determine whether or not the expression of Figure 14 is true. If the expression is false 
then this process ends. 

15 

If step 238 has indicated the type of situation illustrated in Figure 12, then step 
246 is executed which triggers a bytecode prefetch abort exception to be initiated by the 
bytecode exception generator 232. The bytecode exception generator 232 may simply 
trigger execution of the ARM code bytecode prefetch abort handler 236. The abort 
20 handler 236 serves at step 248 to identify the bytecode which starts the variable length 
instruction and then at step 250 triggers execution of the code fragment of ARM 
instructions that emulate that identified bytecode. 

The above described mechanism for dealing with prefetch aborts works well 
25 for situations in which there are four or fewer operands (i.e. five or fewer bytes in 
total), otherwise it would be possible for a bytecode and its operands to overflow the 
second buffer. In practice, the bytecodes for which it is preferred to provide a 
hardware acceleration mechanism all have 0, 1 or 2 operands with the remainder of 
bytecodes being handled in software in all cases, principally due to their complexity. 

30 

Figure 17 illustrates an operating system 300 for controlling a plurality of user 
mode processes 302, 304, 306 and 308. The operating system 300 operates in a 
supervisor mode and the other processes 302, 304, 306 and 308 operate in a user mode 
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having fewer access rights to configuration control parameters of the system than does 
the operating system 300 operating in supervisor mode. 

As illustrated in Figure 17 the processes 302 and 308 respectively relate to 
5 different Java Virtual Machines. Each of these Java Virtual Machines 302, 308 has its 
own configuration data formed of bytecode translation mapping data 310, 312 and 
configuration register data 314, 3 16. In practice, it will be appreciated that a single set of 
Java acceleration hardware is provided for executing both of the processes 302, 308, but 
when these different processes are using the Java acceleration hardware they each 
10 require it to be configured with their associated configuration data 310, 312, 314, 316. 
Thus, when the operating system 300 switches execution to a process using the Java 
acceleration hardware that is different from the previous process that used that hardware, 
then the Java acceleration hardware should be reinitialised and reconfigured. The 
operating system 300 does not do this re-initialisation and reconfiguration of the Java 
15 acceleration hardware itself, but indicates that it should be done by setting a 
configuration invalid indicator associated with the Java acceleration hardware to an 
invalid state. 

Figure 18 schematically illustrates a data processing system 318 including a 
20 processor core 320 having a native instruction set (e.g. the ARM instruction set) and 
associated Java acceleration hardware 322. A memory 324 stores computer program 
code which may be in the form of ARM instructions or Java bytecodes. In the case of 
Java bytecodes, these are passed through the Java acceleration hardware 322 which 
serves to interpret them into a stream of ARM instructions (or control signals 
25 corresponding to ARM instructions) that may then be executed by the processor core 
320. The Java acceleration hardware 322 includes a bytecode translation table 326 that 
requires programming for each Java Virtual Machine for which it is desired to execute 
Java bytecodes. Further a configuration data register 328 and an operating system 
control register 330 are provided within the Java acceleration hardware 322 to control 
30 its configuration. Included within the operating system control register 330 is a 
configuration valid indicator in the form of a flag CV that when set indicates that the 
configuration of the Java acceleration hardware 322 is valid and when unset that it is 
invalid. 
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The Java acceleration hardware 322 when it seeks to execute a Java bytecode is 
responsive to the configuration valid indicator to trigger a configuration invalid 
exception if the configuration valid indicator corresponds to the configuration data for 
the Java acceleration hardware 322 being in an invalid form. The configuration invalid 
5 exception handler can be an ARM code routine provided in a manner similar to that 
discussed above for the prefetch abort handler. A hardware mechanism is provided 
within the Java acceleration hardware 322 that sets the configuration valid indicator to 
the form indicating that the configuration data is valid as the configuration exception is 
triggered and before the new valid configuration data has actually been written into 
10 place. Whilst it may seem counter intuitive to set the configuration valid indicator in this 
way before the configuration data has actually been written, this approach has significant 
advantages in being able to avoid problems that can arise with process swaps part way 
□ through the setting of the configuration data. The configuration exception routine then 

— sets up the required configuration data for the Java Virtual Machine to which it 

I* 15 corresponds by writing the bytecode translation table entries as discussed previously and 
M» any other configuration data register values 328 as required. The configuration 

exception code must ensure that the writing of the configuration data is completed before 
any other tasks are undertaken by the Java acceleration hardware 322. 

20 Figure 19 schematically illustrates the operation of the operating system 300. At 

U step 332, the operating system waits to detect a process switch. When a process switch 

is detected, step 334 determines whether or not the new process is one that uses the Java 
acceleration hardware 322 (also, as previously mentioned, called Jazelle). If the Java 
acceleration hardware 322 is not used, then processing proceeds to step 336 at which the 

25 Java acceleration hardware 322 is disabled before proceeding to step 339 at which 
execution is transferred to the new process. If the Java acceleration hardware 322 is 
used, then processing proceeds to step 338 at which a determination is made as to 
whether or not the new process being invoked is the same as the stored current owner of 
the Java acceleration hardware 322 as recorded by the operating system 300. If the 

30 owner has not changed (i.e. the new process is in fact the same as the last process that 
used the Java acceleration hardware 322), then processing proceeds to step 337 at which 
the Java acceleration hardware 322 is enabled prior to proceeding to step 339. If the new 
process is not the stored current owner, then processing proceeds to step 340 at which 
the configuration valid indicator is set to indicate that the current configuration of the 
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Java acceleration hardware 322 is not valid. This is the limit of the responsibility of the 
operating system 300 for managing this configuration change, the actual updating of the 
configuration data is left as a task to the Java acceleration hardware 322 itself operating 
with its own exception handling mechanisms. 

5 

After step 340, step 342 serves to update the stored current owner to be the new 
process before transfer of execution control is passed to step 337 and then step 339. 

Figure 20 illustrates the operations performed by the Java acceleration hardware 
10 322. At step 344 the Java acceleration hardware 322 waits to receive a bytecode to 
execute. When a bytecode is received, the hardware checks that the configuration valid 
indicator shows that the configuration of the Java acceleration hardware 322 is valid 
using step 346. If the configuration is valid, then processing proceeds to step 348 at 
which the received bytecode is executed. 

15 

If the configuration is invalid, then processing proceeds to step 350 at which the 
. Java acceleration hardware 322 uses a hardware mechanism to set the configuration 
valid indicator to show that the configuration is valid. This could also be done by a 
program instruction within the exception handler if desired. Step 352 serves to trigger a 
20 configuration invalid exception. The configuration invalid exception handler may be 
provided as a combination of a table of pointers to code fragments and appropriate code 
fragments for handling each of the exceptions concerned, such as software emulation of 
an instruction, a prefetch abort (both of which have been discussed above), as in this 
case, or a configuration exception. 

25 

Step 354 serves to execute the ARM code that makes up the configuration 
invalid exception and that serves to write the configuration data required to the Java 
acceleration hardware 322. This ARM code may take the form of a sequence of 
coprocessor register writes to populate the programmable translation table 326 as well as 
30 other configuration registers 330. After step 354, step 356 jumps back into the Java 
bytecode program so as to re-attempt execution of the original bytecode. 

If a process switch occurs during step 354 or step 358, it is possible that the 
configuration set up so far will be made invalid by the other process and the 
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configuration valid indicator cleared by the operating system. In the Figure 20 
procedure , this results in going around the 344-346-350-352-354-loop again, i.e. in 
reconfiguration being re-attempted from the start. When the bytecode does eventually 
actually get executed, the configuration is guaranteed to be valid. 

5 

Figure 21 illustrates a data processing system as shown in Figure 1 further 
incorporating a floating point subsystem. When an unhandled floating point operation 
occurs the floating point subsystem provides mechanisms to handle the unhandled 
floating point operation in ARM code. 

10 

An example of such a subsystem is the VFP software emulator system from 
ARM Limited of Cambridge, England. In the case of the VFP software emulator 
system all floating point operations are treated as unhandled floating point operations 
since there is no hardware available to perform the floating point operations. All 
1 5 floating point operations are therefore handled using the provided mechanisms to 
emulate the behaviour of the VFP in ARM code. 

In the case of such systems unhandled floating point operations are precise, 
that is to say the point of detection of an unhandled floating point operation is the 
20 same as the point of occurance of the unhandled floating point operation. 

Figure 22 illustrates a data processing system as shown in Figures 1 and 21 
further incorporating a floating point operation register and an unhandled operation 
state flag. 

25 

An example of such a subsystem is the VFP hardware system from ARM 
Limited of Cambridge, England. In the case of the VFP hardware system only certain 
types of floating point operation are treated as unhandled floating point operations, 
the remainder being handled by the VFP hardware. 

30 

The class of operations which may be subject to unhandled floating point 
operations include: 

- division by zero 

- operations involving a NaN 
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- operations involving an infinity 

- operations involving denormalised numbers 



In the case of such systems unhandled floating point operation may be 
imprecise, that is to say the point of detection of an unhandled floating point operation 
is not necessarily the same as the point of occurance of the unhandled floating point 
operation. 

An unhandled VFP operation occurs when the VFP coprocessor refuses to 
accept a VFP instruction that would normally form part of an ARM instruction stream 
but in the presence of a bytecode translator shown in Figure 1 may be the result of a 
bytecode which has been translated into a combination of ARM and VFP instructions. 

In the case that an unhandled VFP operation occurs as part of an ARM 
instruction stream, the ARM mechanism for handling the unhandled VFP operation is 
to generate an undefined instruction exception and execute the undefined instruction 
handler installed on the undefined instruction vector. 

In the case of the VFP software emulator system all VFP operations are 
treated as unhandled VFP operations and the same ARM mechanism applies, an 
undefined instruction exception is generated and the undefined instruction handler is 
executed. 



When the unhandled VFP operation occurs as part of the ARM instruction 
25 stream the undefined instruction handler can see by inspecting the instruction stream 
that the instruction which caused the unhandled VFP operation was indeed a VFP 
instruction, not some other kind of undefined instruction and as the undefined 
instruction handler executes in a priviledged mode it can issue the required 
coprocessor instructions to extract any internal state that it needs from the VFP 
30 coprocessor and complete the required instruction in software. The undefined 
instruction handler will use both the instruction identified in the ARM instruction 
stream and the internal state of the VFP to handle the unhandled operation. 
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On many VFP implementations, the instruction that caused the unhandled 
operation may not be the same as the instruction that was executing when the 
unhandled operation was detected. The unhandled operation may have been caused by 
an instruction that was issued earlier, executed in parallel with subsequent ARM 
5 instructions, but which encounters an unhandled condition. The VFP signals this by 
refusing to accept a following VFP instruction, forcing the VFP undefined-instruction 
handler to be entered which can interrogate the VFP to find the original cause of the 
unhandled operation. 

1 o When Jazelle is integrated into a system containing a VFP subsystem the 

following apply: 

- Java floating point instructions are translated by issuing the corresponding 
VFP instructions directly within the core using a set of signals having a direct 
correspondance to VFP instructions. 

1 5 - The VFP may signal an unhandled operation condition if it encounters an 

unhandled operation. 

- Jazelle intercepts the unhandled operation signal preventing it from being 
sent to the core and preventing the undefined instruction handler from executing as 
would happen if a VFP instruction in an ARM instruction stream signalled an 

20 incorrect operation. Instead Jazelle generates a Jazelle VFP exception which is 
handled by the Jazelle VM support code. 

The VM support code, on encountering such a Jazelle VFP exception, should 
execute a VFP 'no -operation' instruction, ie. any VFP instruction which leaves the 

25 Jazelle state intact, such as an FMRX Rd, FPSCR instruction. This synchronises the 
VFP hardware with the support code and completes the operation of any VFP 
operation indicated by the floating point operation register in conjunction with the 
unhandled operation state flag which should be set in this case as an unhandled 
operation has just been encountered. Once the operation is complete the unhandled 

30 operation state flag will be cleared. 

The approach exploits the fact that the instruction sequences issued by Jazelle 
are restartable as described in co-pending British Patent Application Number 
0024402.0 filed on 5 October 2000 which is incorporated herein in its entirety by 
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reference. Use of the technique described in the above reference in conjunction with 
this technique allows the instruction which caused the generation of the VFP 
instruction which caused the unhandled operation to be restarted. 

5 Figure 23 illustrates for each of the Java floating point operations the 

corresponding VFP instructions which are issued by the Java bytecode translator. 
Note that only the VFP instruction which are issued are shown, the Java bytecode 
translator may issue additional ARM instruction(s) in conjunction with the VFP 
instructions. The Jazelle bytecode translator may also issue additional VFP loads and 

10 stores to load or store floating point values. 

Figure 24 illustrates a sequence of instructions or signals corresponding to 

instructions that might be issued by the Jazelle bytecode translator for the sequence of 
ill Java bytecodes consisting of a 'dmul' bytecode followed by a 'dcmpg' bytecode. The 

i n 15 illustrated sequence would occur if a (dmul, dcmpg) bytecode sequence were to be 

executed at a time that the double-precision registers DO, Dl, and D2 hold the third 
ill from top, second from top and top elements of the Java execution stack respectively, 

S and that the integer result of the bytecode sequence is expected to be placed in the 

integer register RO. 

ry 

20 

Figures 25, 27, 29 and 30 illustrate the sequence of operations when an 
unhandled floating point operation occurs at various points in the translated 
instruction sequence. Figures 25 and 29 illustrate the sequence of operations when the 
unhandled floating point operation is caused by the FMULD instruction. Figures 27 
25 and 30 illustrate the sequence of operations when the unhandled floating point 
operation is caused by the FCMPD instruction. Figures 25 and 27 illustrate the 
sequence of operations when the signalling of unhandled floating point operations is 
imprecise. Figures 29 and 30 illustrate the sequence of operations when the signalling 
of unhandled floating point operations is precise. 

30 

As can be seen there are four possible sequence of events: 

1) Figure 25: Imprecise unhandled operation detection, Java bytecode which 

signals the unhandled operation is not the same as that which caused the unhandled 

operation. 
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2) Figure 27: Imprecise unhandled operation detection, Java bytecode which 
signals the unhandled operation is the same as that which caused it despite the fact the 
the system uses imprecise unhandled operation detection. This is because the second 
Java bytecode 'dcmpg' issues 2 VFP instructions for the one Java bytecode, the first of 

5 which causes the unhandled operation, the second of which signals it. 

3) Figure 29: Precise unhandled operation detection, Java bytecode which 
signals the unhandled operation is the same as that which caused it. 

4) Figure 30: Precise unhandled operation detction, Java bytecode which 
signals the unhandled operation is the same as that which caused it, however it is not 

10 known which of the two VFP instructions issued as a result of executing the 'dcmpg' 
bytecode actually caused and signalled the unhandled operation. 

The combination of above mentioned restarting technique with this technique 
allows all these possible sequences of events to be handled correctly. 

15 

Figures 26 and 28 illustrate the state of the floating point operation register 
and the unhandled operation state flag at the point immediately after the unhandled 
operation is caused corresponding to the sequence of operations illustrated in figures 
25 and 27 respectively. 

20 

Reference should be made to the co-pending British patent applications 
0024399.8, 0024402.0, 0024404.6 and 0024396.4 all filed on 5 October 2000, and 
British patent application 0028249.1 filed on 20 November 2000 and United States 
patent application 09/731,060 filed on 7 December 2000 which also describe a Java 
25 bytecode interpretation system. The disclosure of these co-pending applications is 
incorporated herein in its entirety by reference. 

Although illustrative embodiments of the invention have been described in detail 
herein with reference to the accompanying drawings, it is to be understood that the 
30 invention is not limited to those precise embodiments, and that various changes and 
modifications can be effected therein by one skilled in the art without departing from the 
scope and spirit of the invention as defined by the appended claims. 
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